An exploration of service use pattern changes and cost analysis following implementation of community perinatal mental health teams in pregnant women with a history of specialist mental healthcare in England: a national population-based cohort study.

BACKGROUND: The National Health Service in England pledged >£365 million to improve access to mental healthcare services via Community Perinatal Mental Health Teams (CPMHTs) and reduce the rate of perinatal relapse in women with severe mental illness. This study aimed to explore changes in service use patterns following the implementation of CPMHTs in pregnant women with a history of specialist mental healthcare in England, and conduct a cost-analysis on these changes. METHODS: This study used a longitudinal cohort design based on existing routine administrative data. The study population was all women residing in England with an onset of pregnancy on or after 1st April 2016 and who gave birth on or before 31st March 2018 with pre-existing mental illness (N = 70,323). Resource use and costs were compared before and after the implementation of CPMHTs. The economic perspective was limited to secondary mental health services, and the time horizon was the perinatal period (from the start of pregnancy to 1-year post-birth, ~ 21 months). RESULTS: The percentage of women using community mental healthcare services over the perinatal period was higher for areas with CPMHTs (30.96%, n=9,653) compared to areas without CPMHTs (24.72%, n=9,615). The overall percentage of women using acute care services (inpatient and crisis resolution teams) over the perinatal period was lower for areas with CPMHTs (4.94%, n=1,540 vs. 5.58%, n=2,171), comprising reduced crisis resolution team contacts (4.41%, n=1,375 vs. 5.23%, n=2,035) but increased psychiatric admissions (1.43%, n=445 vs. 1.13%, n=441). Total mental healthcare costs over the perinatal period were significantly higher for areas with CPMHTs (fully adjusted incremental cost £111, 95% CI £29 to £192, p-value 0.008). CONCLUSIONS: Following implementation of CPMHTs, the percentage of women using acute care decreased while the percentage of women using community care increased. However, the greater use of inpatient admissions alongside greater use of community care resulted in a significantly higher mean cost of secondary mental health service use for women in the CPMHT group compared with no CPMHT. Increased costs must be considered with caution as no data was available on relevant outcomes such as quality of life or satisfaction with services.

Community perinatal mental health teams and associations with perinatal mental health and obstetric and neonatal outcomes in pregnant women with a history of secondary mental health care in England: a national population-based cohort study.

BACKGROUND: Women with a pre-existing severe mental disorder have an increased risk of relapse after giving birth. We aimed to evaluate associations of the gradual regional implementation of community perinatal mental health teams in England from April, 2016, with access to mental health care and with mental health, obstetric, and neonatal outcomes. METHODS: For this cohort study, we used the national dataset of secondary mental health care provided by National Health Service England, including mental health-care episodes from April 1, 2006, to March 31, 2019, linked at patient level to the Hospital Episode Statistics, and birth notifications from the Personal Demographic Service. We included women (aged ≥18 years) with an onset of pregnancy from April 1, 2016, who had given birth to a singleton baby up to March 31, 2018, and who had a pre-existing mental disorder, defined as contacts with secondary mental health care in the 10 years immediately before pregnancy. The primary outcome was acute relapse, defined as psychiatric hospital admission or crisis resolution team contact in the postnatal period (first year after birth). Secondary outcomes included any secondary mental health care in the perinatal period (pregnancy and postnatal period) and obstetric and neonatal outcomes. Outcomes were compared according to whether a community perinatal mental health team was available before pregnancy, with odds ratios (ORs) adjusted for time trends and maternal characteristics (adjORs). FINDINGS: Of 807 798 maternity episodes in England, we identified 780 026 eligible women with a singleton birth, of whom 70 323 (9·0%) had a pre-existing mental disorder. A postnatal acute relapse was found in 1117 (3·6%) of 31 276 women where a community perinatal mental health team was available and in 1745 (4·5%) of 39 047 women where one was unavailable (adjOR 0·77, 95% CI 0·64-0·92; p=0·0038). Perinatal access to any secondary mental health care was found in 9888 (31·6%) of 31 276 women where a community perinatal mental health team was available and 10 033 (25·7%) of 39 047 women where one was not (adjOR 1·35, 95% CI 1·23-1·49; p<0·0001). Risk of stillbirth and neonatal death was higher where a community perinatal mental health team was available (165 [0·5%] of 30 980 women) than where it was not (151 [0·4%] of 38 693 women; adjOR 1·34, 95% CI 1·09-1·66; p=0·0063), as was the risk of a baby small for gestational age (2227 [7·2%] of 31 030 women vs 2542 [6·6%] of 38 762 women; adjOR 1·10, 1·02-1·20; p=0·016), whereas preterm birth risk was lower (3167 [10·1%] of 31 206 women vs 4341 [11·1%] of 38 961; adjOR 0·86, 0·74-0·99; p=0·032). INTERPRETATION: The regional availability of community perinatal mental health teams reduced the postnatal risk of acute relapse and increased the overall use of secondary mental health care. Community perinatal mental health teams should have close links with maternity services to avoid intensive psychiatric support overshadowing obstetric and neonatal risks. FUNDING: The National Institute for Health and Care Research.

Overcoming training bottlenecks: mixed-methods evaluation of digital training for non-specialists in postnatal depression self-help treatment.

OBJECTIVES: This mixed-methods study evaluated the feasibility, acceptability and preliminary effectiveness of an interactive digital training programme for non-specialist supporters providing a guided self-help intervention for postnatal depression (PND). METHODS: A total of 49 non-specialist trainees participated. Six digital training modules were flexibly delivered over a 5-week period. Training included a chatroom, moderated by a supervised assistant psychologist. Quantitatively, feasibility was assessed via participation and retention levels; acceptability was examined using course evaluation questionnaires; and effectiveness was measured pre-test-post-test quantitatively using a self-report questionnaire and pre-post using scenario questions. Participant focus groups explored feasibility, acceptability and effectiveness. RESULTS: The training was feasible; 41 completed the course and 42 were assessed at follow-up. Quantitative course evaluation and thematic analysis of focus group feedback demonstrated high training acceptability. RANOVAs indicated training significantly improved knowledge and confidence pre- to post-test. There were demonstrable increases in specific skills at post-test as assessed via clinical scenarios. CONCLUSION: This training is a feasible, acceptable and effective way to upskill non-specialists in supporting treatment for PND, however supervised practice is recommended to ensure participants embed knowledge competently into practice. The training offers an effective first step in upskilling non-specialist supporters to support women with PND treatment at scale.

Routine provision of feedback from patient-reported outcome measurements to healthcare providers and patients in clinical practice.

BACKGROUND: Patient-reported outcomes measures (PROMs) assess a patient's subjective appraisal of health outcomes from their own perspective. Despite hypothesised benefits that feedback  on PROMs can support decision-making in clinical practice and improve outcomes, there is uncertainty surrounding the effectiveness of PROMs feedback. OBJECTIVES: To assess the effects of PROMs feedback to patients, or healthcare workers, or both on patient-reported health outcomes and processes of care. SEARCH METHODS: We searched MEDLINE, Embase, CENTRAL, two other databases and two clinical trial registries on 5 October 2020. We searched grey literature and consulted experts in the field. SELECTION CRITERIA: Two review authors independently screened and selected studies for inclusion. We included randomised trials directly comparing the effects on outcomes and processes of care of PROMs feedback to healthcare professionals and patients, or both with the impact of not providing such information. DATA COLLECTION AND ANALYSIS: Two groups of two authors independently extracted data from the included studies and evaluated study quality. We followed standard methodological procedures expected by Cochrane and EPOC. We used the GRADE approach to assess the certainty of the evidence. We conducted meta-analyses of the results where possible. MAIN RESULTS: We identified 116 randomised trials which assessed the effectiveness of PROMs feedback in improving processes or outcomes of care, or both in a broad range of disciplines including psychiatry, primary care, and oncology. Studies were conducted across diverse ambulatory primary and secondary care settings in North America, Europe and Australasia. A total of 49,785 patients were included across all the studies. The certainty of the evidence varied between very low and moderate. Many of the studies included in the review were at risk of performance and detection bias. The evidence suggests moderate certainty that PROMs feedback probably improves quality of life (standardised mean difference (SMD) 0.15, 95% confidence interval (CI) 0.05 to 0.26; 11 studies; 2687 participants), and leads to an increase in patient-physician communication (SMD 0.36, 95% CI 0.21 to 0.52; 5 studies; 658 participants), diagnosis and notation (risk ratio (RR) 1.73, 95% CI 1.44 to 2.08; 21 studies; 7223 participants), and disease control (RR 1.25, 95% CI 1.10 to 1.41; 14 studies; 2806 participants). The intervention probably makes little or no difference for general health perceptions (SMD 0.04, 95% CI -0.17 to 0.24; 2 studies, 552 participants; low-certainty evidence), social functioning (SMD 0.02, 95% CI -0.06 to 0.09; 15 studies; 2632 participants; moderate-certainty evidence), and pain (SMD 0.00, 95% CI -0.09 to 0.08; 9 studies; 2386 participants; moderate-certainty evidence). We are uncertain about the effect of PROMs feedback on physical functioning (14 studies; 2788 participants) and mental functioning (34 studies; 7782 participants), as well as fatigue (4 studies; 741 participants), as the certainty of the evidence was very low. We did not find studies reporting on adverse effects defined as distress following or related to PROM completion. AUTHORS' CONCLUSIONS: PROM feedback probably produces moderate improvements in communication between healthcare professionals and patients as well as in diagnosis and notation, and disease control, and small improvements to quality of life. Our confidence in the effects is limited by the risk of bias, heterogeneity and small number of trials conducted to assess outcomes of interest. It is unclear whether   many of these improvements are clinically meaningful or sustainable in the long term. There is a need for more high-quality studies in this area, particularly studies which employ cluster designs and utilise techniques to maintain allocation concealment.

What drives differences in preferences for health states between patients and the public? A qualitative investigation of respondents' thought processes.

Cost-effectiveness analyses using quality-adjusted life-years (QALYs) are used in decision-making regarding which interventions are available via many national healthcare systems. QALYs are calculated based on health state values provided by preference elicitation techniques. Several national decision-making bodies recommend that health state values should be based on preferences elicited from general populations, rather than from patients. Previous studies have shown systematic differences between health state values elicited from members of the general population and from patients. Various explanations for this phenomenon have been proposed, however empirical evidence for these is scarce. We aimed to explore possible reasons for discrepancies between public and patient valuations by undertaking qualitative cognitive interviews, asking 14 members of the general population and 12 people with multiple sclerosis (MS) to think aloud while completing a preference elicitation task (time trade-off) for MS-related health states. The interviews were undertaken between December 2016 and October 2017 in the South West region of England, and were analysed using the Framework Method. As anticipated, we found that participants with MS had more experience of health problems and used this experience to consider how they might adapt to the health states over time, and which dimensions of health-related quality of life were most important to them. We found no evidence that participants with MS were less affected by framing effects and focusing illusions, more likely to prioritise non-physical dimensions of health, or more prone to loss aversion, endowment effects and non-compensatory decision-making. These findings contribute to our understanding of how patients and members of the general population respond to preference elicitation exercises, and why their preferences may differ, and may help to inform developing areas of research, such as the joint presentation of cost-effectiveness results from multiple perspectives, and the use of preferences elicited from patients for experienced health states.

Integrating Patient Reported Outcome Measures (PROMs) into routine nurse-led primary care for patients with multimorbidity: a feasibility and acceptability study.

BACKGROUND: The use of Patient Reported Outcome Measures (PROMS) in clinical practice has the potential to promote patient-centred care and improve patients' quality of life. Individualized PROMs may be particularly helpful in identifying, prioritizing and monitoring health problems of patients with multimorbidity. We aimed to develop an intervention centred around PROMs feedback as part of Primary Care annual reviews for patients with multimorbidity and evaluate its feasibility and acceptability. METHODS: We developed a nurse-oriented intervention including (a) training of nurses on PROMs; (b) administration to patients with multimorbidity of individualized and standardized PROMS; and (c) feedback to both patients and nurses of PROMs scores and interpretation guidance. We then tailored the intervention to patients with two or more highly prevalent conditions (asthma, COPD, diabetes, heart failure, depression, and hip/knee osteoarthritis) and designed a non-controlled feasibility and acceptability evaluation in a convenience sample of primary care practices (5). PROMs were administered and scores fed back immediately ahead of scheduled annual reviews with nurses. Patients and nurses rated the acceptability of the intervention using with a brief survey including optional free comments. Thematic analysis of qualitative interviews with a sample of participating patients (10) and nurses (4) and of survey free comments was conducted for further in-depth evaluation of acceptability. Feasibility was estimated based on rates of participation and completion. RESULTS: Out of 68 recruited patients (mean age 70; 47% female), 68 completed the PROMs (100%), received feedback (100%) and confirmed nurse awareness of their scores (100%). Most patients (83%) "agreed"/"strongly agreed" that the PROMs feedback had been useful, a view supported by nurses in 89% of reviews. Thematic analysis of rich qualitative data on PROMS administration, feedback and role in annual reviews indicated that both patients and nurses perceived the intervention as acceptable and promising, emphasizing its comprehensiveness and patient-centredness. CONCLUSIONS: We have developed and tested an intervention focusing on routine PROM assessment of patients with multimorbidity in Primary Care. Preliminary findings support its feasibility and a high degree of acceptability from both patients and nurses. The next step is to conduct a full-scale trial for evaluating the effectiveness of the proposed intervention.

Assessing Patient-Centred Outcomes in Lateral Elbow Tendinopathy: A Systematic Review and Standardised Comparison of English Language Clinical Rating Systems.

BACKGROUND: Lateral elbow tendinopathy (LET) is a common condition affecting adults. Although a lack of treatment consensus continues to prompt numerous effectiveness studies, there is a paucity of clear guidance on the choice of outcome measure. Our aim was to undertake a standardised evaluation of the available clinical rating systems that report patient-centred outcomes in LET. METHODS: A systematic review of studies reporting the development, assessment of metric properties and/or use of instruments aiming to quantify LET-specific patient-centred outcome measures was conducted in MEDLINE, Embase and CINAHL (inception-2017) adhering to PRISMA guidance. The evidence for each instrument was independently assessed by two reviewers using the standardised evaluating measures of patient-reported outcomes (EMPRO) method evaluating overall and attribute-specific instrument performance (metric properties and usability). EMPRO scores > 50/100 were considered indicative of high performance. RESULTS: Out of 7261 references, we identified 105 articles reporting on 15 instruments for EMPRO analysis. Median performance score was 41.6 (range 21.6-72.5), with four instruments meeting high-performance criteria: quick Disabilities of the Arm Shoulder and Hand score (qDASH) (72.5), DASH (66.9), Oxford Elbow Score (OES) (66.6) and Patient-Rated Tennis Elbow Evaluation (PRTEE) (57.0). One hundred seventy-nine articles reported instrument use internationally with DASH as the most frequent (29.7% articles) followed by PRTEE (25.6%), MEPS (15.1%) and qDASH (8.1%). The correlation between frequency of use and performance was r = 0.35 (95%CI - 0.11; 0.83). CONCLUSIONS: This is the first study to provide standardised guidance on the choice of measures for LET. A large number of clinical rating systems are both available and being used for patients with LETs. Robust evidence is available for four measures, the DASH, QDASH, PRTEE and OES. The use of instruments in the literature is only in part explained by instrument performance.

The Evaluation of Physicians' Communication Skills From Multiple Perspectives.

PURPOSE: To examine how family physicians', patients', and trained clinical raters' assessments of physician-patient communication compare by analysis of individual appointments. METHODS: Analysis of survey data from patients attending face-to-face appointments with 45 family physicians at 13 practices in England. Immediately post-appointment, patients and physicians independently completed a questionnaire including 7 items assessing communication quality. A sample of videotaped appointments was assessed by trained clinical raters, using the same 7 communication items. Patient, physician, and rater communication scores were compared using correlation coefficients. RESULTS: Included were 503 physician-patient pairs; of those, 55 appointments were also evaluated by trained clinical raters. Physicians scored themselves, on average, lower than patients (mean physician score 74.5; mean patient score 94.4); 63.4% (319) of patient-reported scores were the maximum of 100. The mean of rater scores from 55 appointments was 57.3. There was a near-zero correlation coefficient between physician-reported and patient-reported communication scores (0.009, P = .854), and between physician-reported and trained rater-reported communication scores (-0.006, P = .69). There was a moderate and statistically significant association, however, between patient and trained-rater scores (0.35, P = .042). CONCLUSIONS: The lack of correlation between physician scores and those of others indicates that physicians' perceptions of good communication during their appointments may differ from those of external peer raters and patients. Physicians may not be aware of how patients experience their communication practices; peer assessment of communication skills is an important approach in identifying areas for improvement.

Enhanced psychological care in cardiac rehabilitation services for patients with new-onset depression: the CADENCE feasibility study and pilot RCT.

BACKGROUND: Around 19% of people screened by UK cardiac rehabilitation programmes report having moderate or severe symptoms of depression. These individuals are at an increased risk of cardiac mortality and morbidity, reduced quality of life and increased use of health resources compared with their non-depressed counterparts. Maximising psychological health is a goal of cardiac rehabilitation, but psychological care is patchy. OBJECTIVE(S): To examine the feasibility and acceptability of embedding enhanced psychological care (EPC) within cardiac rehabilitation, we tested the feasibility of developing/implementing EPC and documented the key uncertainties associated with undertaking a definitive evaluation. DESIGN: A two-stage multimethods study; a feasibility study and a qualitative evaluation, followed by an external pilot cluster randomised controlled trial (RCT) with a nested qualitative study. SETTING: UK comprehensive cardiac rehabilitation teams. PARTICIPANTS: Adults eligible for cardiac rehabilitation following an acute coronary syndrome with new-onset depressive symptoms on initial nurse assessment. Patients who had received treatment for depression in the preceding 6 months were excluded. INTERVENTIONS: The EPC intervention comprised nurse-led mental health-care co-ordination and behavioural activation within cardiac rehabilitation. The comparator was usual cardiac rehabilitation care. MAIN OUTCOME MEASURES: Measures at baseline, and at the 5- (feasibility and pilot) and 8-month follow-ups (pilot only). Process measures related to cardiac team and patient recruitment, and participant retention. Outcomes included depressive symptoms, cardiac mortality and morbidity, anxiety, health-related quality of life and service resource use. Interviews explored participant and nurses' views and experiences. RESULTS: Between September 2014 and May 2015, five nurses from four teams recruited participants into the feasibility study. Of the 203 patients screened, 30 were eligible and nine took part (the target was 20 participants). At interview, participants and nurses gave valuable insights into the EPC intervention design and delivery. Although acceptable, the EPC delivery was challenging for nurses (e.g. the ability to allocate sufficient time within existing workloads) and the intervention was modified accordingly. Between December 2014 and February 2015, 8 out of 20 teams approached agreed to participate in the pilot RCT [five were randomised to the EPC arm and three were randomised to the usual-care (UC) arm]. Of the 614 patients screened, 55 were eligible and 29 took part (the target was 43 participants). At baseline, the trial arms were well matched for sex and ethnicity, although the EPC arm participants were younger, from more deprived areas and had higher depression scores than the UC participants. A total of 27 out of 29 participants were followed up at 5 months. Interviews with 18 participants (12 in the EPC arm and six in the UC arm) and seven nurses who delivered EPC identified that both groups acknowledged the importance of receiving psychological support embedded within routine cardiac rehabilitation. For those experiencing/delivering EPC, the intervention was broadly acceptable, albeit challenging to deliver within existing care. LIMITATIONS: Both the feasibility and the pilot studies encountered significant challenges in recruiting patients, which limited the power of the pilot study analyses. CONCLUSIONS: Cardiac rehabilitation nurses can be trained to deliver EPC. Although valued by both patients and nurses, organisational and workload constraints were significant barriers to implementation in participating teams, suggesting that future research may require a modified approach to intervention delivery within current service arrangements. We obtained important data informing definitive research regarding participant recruitment and retention, and optimal methods of data collection. FUTURE RESEARCH: Consideration should be given to the delivery of EPC by dedicated mental health practitioners, working closely with cardiac rehabilitation services. TRIAL REGISTRATION: Current Controlled Trials ISRCTN34701576. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 22, No. 30. See the NIHR Journals Library website for further project information.

Assessing the effectiveness of Enhanced Psychological Care for patients with depressive symptoms attending cardiac rehabilitation compared with treatment as usual (CADENCE): a pilot cluster randomised controlled trial.

BACKGROUND: Around 17% of people attending UK cardiac rehabilitation programmes have depression. Optimising psychological wellbeing is a rehabilitation goal, but provision of psychological care is limited. We developed and piloted an Enhanced Psychological Care (EPC) intervention embedded within cardiac rehabilitation, aiming to test key areas of uncertainty to inform the design of a definitive randomised controlled trial (RCT) and economic evaluation. METHODS: An external pilot randomised controlled trial (RCT) randomised eight cardiac rehabilitation teams (clusters) to either usual care of cardiac rehabilitation provision (UC), or EPC in addition to UC. EPC comprised mental health care coordination and patient-led behavioural activation with nurse support. Adults eligible for cardiac rehabilitation following an acute coronary syndrome and identified with new-onset depressive symptoms during an initial nurse assessment were eligible. Measures were performed at baseline and 5- and 8-month follow-ups and compared between EPC and UC. Team and participant recruitment and retention rates, and participant outcomes (clinical events, depression, anxiety, health-related quality of life, patient experiences, and resource use) were assessed. RESULTS: Eight out of twenty teams were recruited and randomised. Of 614 patients screened, 55 were eligible and 29 took part (5%, 95% CI 3 to 7% of those screened), with 15 patient participants cluster randomised to EPC and 14 to UC. Nurse records revealed that 8/15 participants received the maximum number of EPC sessions offered; and 4/15 received no sessions. Seven out of fifteen EPC participants were referred to another NHS psychological service compared to none in UC. We followed up 27/29 participants at 5 months and 17/21 at 8 months. The mean difference (EPC minus UC) in depressive symptoms (Beck Depression Inventory) at follow-up (adjusting for baseline score) was 1.7 (95% CI - 3.8 to 7.3; N = 26) at 5 months and 4.4 (95% CI - 1.4 to 10.2; N = 17) at 8 months. DISCUSSION: While valued by patients and nurses, organisational and workload constraints are significant barriers to EPC implementation. There remains a need to develop and test new models of psychological care within cardiac rehabilitation. Our study offers important data to inform the design of future trials of similar interventions. TRIAL REGISTRATION: ISRCTN34701576 . Registered on 29 May 2014. Funding details: UK NIHR HTA Programme (project 12/189/09).

Rating Communication in GP Consultations: The Association Between Ratings Made by Patients and Trained Clinical Raters.

Patient evaluations of physician communication are widely used, but we know little about how these relate to professionally agreed norms of communication quality. We report an investigation into the association between patient assessments of communication quality and an observer-rated measure of communication competence. Consent was obtained to video record consultations with Family Practitioners in England, following which patients rated the physician's communication skills. A sample of consultation videos was subsequently evaluated by trained clinical raters using an instrument derived from the Calgary-Cambridge guide to the medical interview. Consultations scored highly for communication by clinical raters were also scored highly by patients. However, when clinical raters judged communication to be of lower quality, patient scores ranged from "poor" to "very good." Some patients may be inhibited from rating poor communication negatively. Patient evaluations can be useful for measuring relative performance of physicians' communication skills, but absolute scores should be interpreted with caution.

Investigating the meaning of 'good' or 'very good' patient evaluations of care in English general practice: a mixed methods study.

OBJECTIVE: To examine concordance between responses to patient experience survey items evaluating doctors' interpersonal skills, and subsequent patient interview accounts of their experiences of care. DESIGN: Mixed methods study integrating data from patient questionnaires completed immediately after a video-recorded face-to-face consultation with a general practitioner (GP) and subsequent interviews with the same patients which included playback of the recording. SETTING: 12 general practices in rural, urban and inner city locations in six areas in England. PARTICIPANTS: 50 patients (66% female, aged 19-96 years) consulting face-to-face with 32 participating GPs. MAIN OUTCOME MEASURES: Positive responses to interpersonal skills items in a postconsultation questionnaire ('good' and 'very good') were compared with experiences reported during subsequent video elicitation interview (categorised as positive, negative or neutral by independent clinical raters) when reviewing that aspect of care. RESULTS: We extracted 230 textual statements from 50 interview transcripts which related to the evaluation of GPs' interpersonal skills. Raters classified 70.9% (n=163) of these statements as positive, 19.6% (n=45) neutral and 9.6% (n=22) negative. Comments made by individual patients during interviews did not always express the same sentiment as their responses to the questionnaire. Where questionnaire responses indicated that interpersonal skills were 'very good', 84.6% of interview statements concerning that item were classified as positive. However, where patients rated interpersonal skills as 'good', only 41.9% of interview statements were classified as positive, and 18.9% as negative. CONCLUSIONS: Positive responses on patient experience questionnaires can mask important negative experiences which patients describe in subsequent interviews. The interpretation of absolute patient experience scores in feedback and public reporting should be done with caution, and clinicians should not be complacent following receipt of 'good' feedback. Relative scores are more easily interpretable when used to compare the performance of providers.

Patients' use and views of real-time feedback technology in general practice.

BACKGROUND: There is growing interest in real-time feedback (RTF), which involves collecting and summarizing information about patient experience at the point of care with the aim of informing service improvement. OBJECTIVE: To investigate the feasibility and acceptability of RTF in UK general practice. DESIGN: Exploratory randomized trial. SETTING/PARTICIPANTS: Ten general practices in south-west England and Cambridgeshire. All patients attending surgeries were eligible to provide RTF. INTERVENTION: Touch screens were installed in waiting areas for 12 weeks with practice staff responsible for encouraging patients to provide RTF. All practices received fortnightly feedback summaries. Four teams attended a facilitated reflection session. OUTCOMES: RTF 'response rates' among consulting patients were estimated, and the representativeness of touch screen users were assessed. The frequency of staff-patient interactions about RTF (direct observation) and patient views of RTF (exit survey) were summarized. Associated costs were collated. RESULTS: About 2.5% consulting patients provided RTF (range 0.7-8.0% across practices), representing a mean of 194 responses per practice. Patients aged above 65 were under-represented among touch screen users. Receptionists rarely encouraged RTF but, when this did occur, 60% patients participated. Patients were largely positive about RTF but identified some barriers. Costs per practice for the twelve-week period ranged from £1125 (unfacilitated team-level feedback) to £1887 (facilitated team ± practitioner-level feedback). The main cost was the provision of touch screens. CONCLUSIONS: Response rates for RTF were lower than those of other survey modes, although the numbers of patients providing feedback to each practice were comparable to those achieved in the English national GP patient survey. More patients might engage with RTF if the opportunity were consistently highlighted to them.

Test-retest stability of patient experience items derived from the national GP patient survey.

PURPOSE: The validity and reliability of various items on the GP Patient Survey (GPPS) survey have been reported, however stability of patient responses over time has not been tested. The purpose of this study was to determine the test-retest reliability of the core items from the GPPS. METHODS: Patients who had recently consulted participating GPs in five general practices across the South West England were sent a postal questionnaire comprising of 54 items concerning their experience of their consultation and the care they received from the GP practice. Patients returning the questionnaire within 3 weeks of mail-out were sent a second identical (retest) questionnaire. Stability of responses was assessed by raw agreement rates and Cohen's kappa (for categorical response items) and intraclass correlation coefficients and means (for ordinal response items). RESULTS: 348 of 597 Patients returned a retest questionnaire (58.3 % response rate). In comparison to the test phase, patients responding to the retest phase were older and more likely to have white British ethnicity. Raw agreement rates for the 33 categorical items ranged from 66 to 100 % (mean 88 %) while the kappa coefficients ranged from 0.00 to 1.00 (mean 0.53). Intraclass correlation coefficients for the 21 ordinal items averaged 0.67 (range 0.44-0.77). CONCLUSIONS: Formal testing of items from the national GP patient survey examining patient experience in primary care highlighted their acceptable temporal stability several weeks following a GP consultation.

Capturing patient experience: a qualitative study of implementing real-time feedback in primary care.

BACKGROUND: In recent years, hospitals have made use of new technologies, such as real-time feedback, to collect patient experience information. This approach is currently rarely used in primary care settings, but may provide practices with a useful tool that enables them to take prompt, focused action to improve their services. AIM: To identify the factors inhibiting and enabling the implementation of real-time feedback in general practices. DESIGN AND SETTING: Qualitative study embedded within an exploratory trial (July 2014 to February 2015) of a real-time feedback intervention targeting patient experience in general practices in south-west England and Cambridgeshire. METHOD: Semi-structured interviews (n = 22) and focus groups (n = 4, total of 28 attendees) with practice staff were audiorecorded, transcribed, and analysed thematically, using a framework based on constructs from normalisation process theory. RESULTS: Staff engagement with real-time feedback varied considerably, and staff made sense of real-time feedback by comparing it with more familiar feedback modalities. Effective within-team communication was associated with positive attitudes towards real-time feedback. Timing of requests for feedback was important in relation to patient engagement. Real-time feedback may offer potential as a means of informing practice development, perhaps as a component of a wider programme of capturing and responding to patients' comments. CONCLUSION: Successful implementation of real-time feedback requires effective communication across the practice team to engender thorough engagement. Feedback processes should be carefully introduced to fit with existing patient and practice routines. Future studies should consider making real-time feedback content relevant to specific practice needs, and support participation by all patient groups.

Assessing the effectiveness of enhanced psychological care for patients with depressive symptoms attending cardiac rehabilitation compared with treatment as usual (CADENCE): study protocol for a pilot cluster randomised controlled trial.

BACKGROUND: Around 17% of people eligible for UK cardiac rehabilitation programmes following an acute coronary syndrome report moderate or severe depressive symptoms. While maximising psychological health is a core goal of cardiac rehabilitation, psychological care can be fragmented and patchy. This study tests the feasibility and acceptability of embedding enhanced psychological care, composed of two management strategies of proven effectiveness in other settings (nurse-led mental health care coordination and behavioural activation), within the cardiac rehabilitation care pathway. METHODS/DESIGN: This study tests the uncertainties associated with a large-scale evaluation by conducting an external pilot trial with a nested qualitative study. We aim to recruit and randomise eight comprehensive cardiac rehabilitation teams (clusters) to intervention (embedding enhanced psychological care into routine cardiac rehabilitation programmes) or control (routine cardiac rehabilitation programmes alone) arms. Up to 64 patients (eight per team) identified with depressive symptoms upon initial assessment by the cardiac rehabilitation team will be recruited, and study measures will be administered at baseline (before starting rehabilitation) and at 5 months and 8 months post baseline. Outcomes include depressive symptoms, cardiac mortality and morbidity, anxiety, health-related quality of life and service resource use. Trial data on cardiac team and patient recruitment, and the retention and flow of patients through treatment will be used to assess intervention feasibility and acceptability. Qualitative interviews will be undertaken to explore trial participants' and cardiac rehabilitation nurses' views and experiences of the trial methods and intervention, and to identify reasons why patients declined to take part in the trial. Outcome data will inform a sample size calculation for a definitive trial. DISCUSSION: The pilot trial and qualitative study will inform the design of a fully powered cluster randomised controlled trial to evaluate the effectiveness and cost-effectiveness of the provision of enhanced psychological care within cardiac rehabilitation programmes. TRIAL REGISTRATION: ISRCTN34701576 (Registered 29 May 2014).

Web-based textual analysis of free-text patient experience comments from a survey in primary care.

BACKGROUND: Open-ended questions eliciting free-text comments have been widely adopted in surveys of patient experience. Analysis of free text comments can provide deeper or new insight, identify areas for action, and initiate further investigation. Also, they may be a promising way to progress from documentation of patient experience to achieving quality improvement. The usual methods of analyzing free-text comments are known to be time and resource intensive. To efficiently deal with a large amount of free-text, new methods of rapidly summarizing and characterizing the text are being explored. OBJECTIVE: The aim of this study was to investigate the feasibility of using freely available Web-based text processing tools (text clouds, distinctive word extraction, key words in context) for extracting useful information from large amounts of free-text commentary about patient experience, as an alternative to more resource intensive analytic methods. METHODS: We collected free-text responses to a broad, open-ended question on patients' experience of primary care in a cross-sectional postal survey of patients recently consulting doctors in 25 English general practices. We encoded the responses to text files which were then uploaded to three Web-based textual processing tools. The tools we used were two text cloud creators: TagCrowd for unigrams, and Many Eyes for bigrams; and Voyant Tools, a Web-based reading tool that can extract distinctive words and perform Keyword in Context (KWIC) analysis. The association of patients' experience scores with the occurrence of certain words was tested with logistic regression analysis. KWIC analysis was also performed to gain insight into the use of a significant word. RESULTS: In total, 3426 free-text responses were received from 7721 patients (comment rate: 44.4%). The five most frequent words in the patients' comments were "doctor", "appointment", "surgery", "practice", and "time". The three most frequent two-word combinations were "reception staff", "excellent service", and "two weeks". The regression analysis showed that the occurrence of the word "excellent" in the comments was significantly associated with a better patient experience (OR=1.96, 95%CI=1.63-2.34), while "rude" was significantly associated with a worse experience (OR=0.53, 95%CI=0.46-0.60). The KWIC results revealed that 49 of the 78 (63%) occurrences of the word "rude" in the comments were related to receptionists and 17(22%) were related to doctors. CONCLUSIONS: Web-based text processing tools can extract useful information from free-text comments and the output may serve as a springboard for further investigation. Text clouds, distinctive words extraction and KWIC analysis show promise in quick evaluation of unstructured patient feedback. The results are easily understandable, but may require further probing such as KWIC analysis to establish the context. Future research should explore whether more sophisticated methods of textual analysis (eg, sentiment analysis, natural language processing) could add additional levels of understanding.

The role of patient experience surveys in quality assurance and improvement: a focus group study in English general practice.

BACKGROUND: Despite widespread adoption of patient feedback surveys in international health-care systems, including the English NHS, evidence of a demonstrable impact of surveys on service improvement is sparse. OBJECTIVE: To explore the views of primary care practice staff regarding the utility of patient experience surveys. DESIGN: Qualitative focus groups. SETTING AND PARTICIPANTS: Staff from 14 English general practices. RESULTS: Whilst participants engaged with feedback from patient experience surveys, they routinely questioned its validity and reliability. Participants identified surveys as having a number of useful functions: for patients, as a potentially therapeutic way of getting their voice heard; for practice staff, as a way of identifying areas of improvement; and for GPs, as a source of evidence for professional development and appraisal. Areas of potential change stimulated by survey feedback included redesigning front-line services, managing patient expectations and managing the performance of GPs. Despite this, practice staff struggled to identify and action changes based on survey feedback alone. DISCUSSION: Whilst surveys may be used to endorse existing high-quality service delivery, their use in informing changes in service delivery is more challenging for practice staff. Drawing on the Utility Index framework, we identified concerns relating to reliability and validity, cost and feasibility acceptability and educational impact, which combine to limit the utility of patient survey feedback. CONCLUSIONS: Feedback from patient experience surveys has great potential. However, without a specific and renewed focus on how to translate feedback into action, this potential will remain incompletely realized.

Understanding high and low patient experience scores in primary care: analysis of patients' survey data for general practices and individual doctors.

OBJECTIVES: To determine the extent to which practice level scores mask variation in individual performance between doctors within a practice. DESIGN: Analysis of postal survey of patients' experience of face-to-face consultations with individual general practitioners in a stratified quota sample of primary care practices. SETTING: Twenty five English general practices, selected to include a range of practice scores on doctor-patient communication items in the English national GP Patient Survey. PARTICIPANTS: 7721 of 15,172 patients (response rate 50.9%) who consulted with 105 general practitioners in 25 practices between October 2011 and June 2013. MAIN OUTCOME MEASURE: Score on doctor-patient communication items from post-consultation surveys of patients for each participating general practitioner. The amount of variance in each of six outcomes that was attributable to the practices, to the doctors, and to the patients and other residual sources of variation was calculated using hierarchical linear models. RESULTS: After control for differences in patients' age, sex, ethnicity, and health status, the proportion of variance in communication scores that was due to differences between doctors (6.4%) was considerably more than that due to practices (1.8%). The findings also suggest that higher performing practices usually contain only higher performing doctors. However, lower performing practices may contain doctors with a wide range of communication scores. CONCLUSIONS: Aggregating patients' ratings of doctors' communication skills at practice level can mask considerable variation in the performance of individual doctors, particularly in lower performing practices. Practice level surveys may be better used to "screen" for concerns about performance that require an individual level survey. Higher scoring practices are unlikely to include lower scoring doctors. However, lower scoring practices require further investigation at the level of the individual doctor to distinguish higher and lower scoring general practitioners.

Trust, negotiation, and communication: young adults' experiences of primary care services.

BACKGROUND: Young adulthood is an important transitional period during which there is a higher risk of individuals engaging in behaviours which could have a lasting impact on their health. Research has shown that young adults are the lowest responders to surveys about healthcare experiences and are also the least satisfied with the care they receive. However, the factors contributing to this reduced satisfaction are not clear. The focus of our research was to explore the needs and experiences of young adults around healthcare services with an aim of finding out possible reasons for lower satisfaction. METHODS: Twenty young adults were interviewed at GP surgeries and at a local young adult advice agency, exploring their experiences and use of primary care services. Interviews were analysed using thematic analysis. RESULTS: The use of primary care services varied amongst the young adult interviewees. Many interviewees reported positive experiences; those who did not linked their negative experiences to difficulties in negotiating their care with the health care system, and reported issues with trust, and communication difficulties. Most of the interviewees were unaware of the use of patient surveys to inform healthcare planning and delivery and were not inclined to take part, mainly because of the length of surveys and lack of interest in the topic area. CONCLUSIONS: In order to effectively address the health needs of young adults, young adults need to be educated about their rights as patients, and how to most efficiently use primary care services. GPs should be alert to effective means of approaching and handling the healthcare needs of young adults. A flexible, varied approach is needed to gathering high quality data from this group in order to provide services with information on the changes necessary for making primary care services more accessible for young adults.